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FIELD OF THE INVENTION 

[0001] The invention relates to a method for searching for symbol 
sequences by applying a path metric for example for decoding a received 
symbol or for reducing intersymboi interference (ISI) in a receiver. 

BACKGROUND OF THE INVENTION 

[0002] In radio communication systems, signals propagate from the 
transmitter to the receiver in the form of electromagnetic waves in a radio 
channel. A signal transmitted in the radio channel is affected by different kinds 
of distortions and therefore the received signal deviates from the one 
transmitted. Despite the distortion, the transmitted information has to be 
detected in the receiver. Various methods have been developed to ensure 
successful signal detection, for example search methods, or algorithms, based 
on diverse diagrams, such as trellis diagrams or tree diagrams. These 
algorithms are used in an attempt to find the path, i.e. symbol sequence (a 
symbol sequence comprising at least one bit), leading through the diagram in 
which the path metric is the smallest, the path metric being typically the sum of 
the Hamming weights or the squared Euclidean distances of different state 
transitions; in other words, they are based on the Viterbi algorithm. The Viterbi 
algorithm Is extremely complex and therefore slow, which is why it is usually 
not suitable as such for practical applications. The algorithms referred to are 
suboptimal: they are many and they are applicable to different purposes of 
use. They are used for example in channel equalizers, for decoding signals 
coded in various ways, in speech recognition, and in multi-user detectors 
(MUD). Examples of the algorithms include M-algorithm, Fano algorithm, 
decision-feedback sequence estimation (DFSE), which are all hard decision 
algorithms. Soft decision algorithms include soft decision DFSE and a soft 
decision M-algorithm. 

[0003] However, if the first value of a channel impulse response is 
not the highest value, prior art algorithms function deficiently. In previous 
attempts to solve this problem, a prefilter is arranged in front of the channel 
equalizer to concentrate the received signal's energy at the beginning of the 
impulse response. The prefilter, however, increases the complexity of the 
system and lengthens the time needed for processing the signal. There are 
situations where even the prefilter does not manage to provide enough power 



for the first impulse response value. In addition, if the first impulse response 
value used for determining the channel impulse response is unreliable or too 
low, the reliability of sequence estimation is impaired. 

BRIEF DESCRIPTION OF THE INVENTION 

[0004] It is an object of the invention to provide an improved 
suboptimal method based on the Viterbi algorithm for searching for a symbol 
sequence typically in a receiver. 

[0005] This is achieved with a suboptimal method for searching for 
a symbol sequence, the method comprising the steps of: determining a 
channel impulse response, sampling a received signal, selecting at least one 
of the highest and/or most reliable impulse response values, determining a 
reference signal using the at least one impulse response value and a symbol 
sequence assumed as transmitted, determining differential terms 
corresponding to the selected impulse response values for the signal sample 
and the reference signal, applying the determined differential tenns to a 
symbol sequence transition metric for searching for a symbol sequence, 
forming a survivor path by adding the symbol sequence provided by the 
transition metric to the survivor path formed so far. 

[0006] The invention further relates to a receiver implementing the 
method, in which receiver a symbol sequence is searched for. The receiver 
comprises means for determining a channel impulse response; means for 
sampling a received signal; means for selecting at least one of the highest 
and/or most reliable impulse response values; means for determining a 
reference signal using the at least one impulse response value and a symbol 
sequence assumed as transmitted; means for determining differential terms 
corresponding to the selected impulse response values for the signal sample 
and the reference signal; means for using the determined differential terms in 
a transition metric for searching for a symbol sequence; means for forming a 
survivor path by adding the symbol sequence provided by the transition metric 
to the survivor path formed so far. 

[0007] The preferred embodiments of the invention are disclosed in 
the dependent claims, 

[0008] The invention is based on the idea that the transition metric 
is adapted to the estimated channel impulse response so that the terms of the 
transition metric, or some of them, correspond to the selected highest and/or 



most reliable Impulse response values. In addition, the reference signals 
needed for determining the terms can also be calculated using only some of 
the determined Impulse response values, preferably the impulse response 
value used together with the corresponding sample signal to calculate the 
differential term, or later Impulse response values, or some of them. 

[0009] The method and system of the invention provide various 
advantages. The method of the invention allow to improve the reliability of 
suboptimal algorithms based on the Viterbi algorithm, particularly in cases 
where signal energy in the channel impulse response is not concentrated at 
the beginning of the impulse response, the method thereby eliminating the 
need for separate prefllters. In addition, if the measurement or other 
estimation used for determining the channel impulse response fails, for 
example one of the Impulse response values provided is unreliable, the 
method allows the differential term corresponding to the impulse response 
value concerned to be replaced in the symbol sequence transition metric by a 
differential term corresponding to some other value, which increases the 
reliability of the symbol sequence estimation. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] In the following the invention will be described in greater 
detail in connection with preferred embodiments and with reference to the 
accompanying drawings, in which 

Figure 1 shows an example of a telecommunications system; 

Figures 2a-c illustrate an example of a trellis diagram; 

Figure 3 is a flow diagram illustrating the method steps for 
searching for a symbol sequence; 

Figures 4a-c illustrate examples of a channel impulse response; 

Figures 5a-b show simulation results of the channels of Figures 4a- 

b; 

Figure 6 is a block diagram illustrating an example of a receiver 

structure. 

DESCRIPTION OF THE EMBODIMENTS 

[0011] The present invention can be used in diverse wireless 
communication system, such as cellular radio systems. The multiple access 
method to be used is not relevant. For example, CDMA (Code Division 
Multiple Access), WCDMA (Wideband Code Division Multiple Access) and 



TDMA (Time Division IVluitiple Access), or their liybrids, may be used. It is also 
apparent to a person skilled in the art that the method of the invention can also 
be applied to systems employing different modulation methods or air interface 
standards. The method of the invention is particularly suitable for systems 
employing multi-layer modulation methods, such as the EDGE system 
(enhanced data rates for GSM evolution), which is a modification of the GSM 
system (Groupe Special Mobile) and which employs 8-PSK modulation. 

[0012] Figure 1 illustrates schematically a digital data transfer 
system in which the solution of the invention can be applied. It is a part of a 
cellular radio system comprising a base station 104 having a radio connection 
108 and 110 to subscriber terminals 100 and 102, which may be fixedly 
mounted, vehicle-mounted or portable terminals. The base station comprises 
transceivers, which are connected to an antenna unit that provides a radio 
connection to the subscriber terminal. The base station further communicates 
with a base station controller 106, which forwards the terminals' connections in 
the network. The base station controller controls in a centralized manner a 
plural number of base stations connected to it. The base station controller 
comprises a control unit responsible for call control, mobility management, 
collection of statistical information and signalling. 

[0013] The public switched telephone network can also be 
contacted from the cellular radio system. 

[0014] Figures 2a-c show a schematic example of trellis diagrams. 
The example shown in Figures 2a-c only serves to illustrate the basic 
principles of the Viterbi algorithm and does not restrict the application of the 
invention in any way. The example is taken from Edward A. Lee, David G. 
Messerschmitt: Digital Communications, pp. 268-275, incorporated herein as a 
reference. 

[0015] A received signal has been sampled and, thereby, samples 
having values 0.2, 0.6, 0.9 and 0.1 have been obtained. The samples typically 
represent the power values of the received signal. At this stage the received 
signal is thus a discrete analog signal. The modulation method used in the 
system and thus the symbol sequences sent by the transmitter are known. 
The example of Figures 2a-c shows the simplest case possible in which there 
are only two levels: 0 200 and 1 202. The levels could also be +1 or -1 levels, 
or there could be more of them, and the levels could comprise a plural number 
of bits. In 8-PSK modulation, for example, there are eight levels, each 



consisting of symbol sequences of three bits. The states in the diagram, i.e. 
the symbol sequences possibly transmitted, are one below the other and time 
Is read from left to right. In the example in question, the channel impulse 
response is estimated to take the following form: \ = d^+Q,5-S^_^, i.e. at the 
time of observation, the system output depends not only on the input at the 
time of observation, but also on the input at a previous time instant. The 
reference values used in the metric are therefore those shown in Table 1 
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Table 1. 



[0016] In the following, the searching for the symbol sequence will 
be described with reference to Figure 2a in a situation where the transition 
metrics are determined on the basis of the squared Euclidean distances. In 
this example, the received signal is processed as a discrete analog signal. The 
trellis starts from 0-state. The first observation is 0.2, the squared Euclidean 
distance being obtained by |0.2-0f which produces 0.04, which is thus the 
first transition metric value. Similarly, |0.2- Ip Is calculated to obtain 0.64. 

[0017] The next observation is 0.6, calculation from 0-state to 0- 
state being performed by |0.6-0p, the value of which is 0.36, and from 0-state 
to 1-state by \0.6-f , the result being 0.16. Calculation from 1-state to 0-state, 
In turn, is performed by |0.6-0.5p, the value of which Is 0.01 and transition 
from 1-state to 1-state is calculated by |0.6-1.5p to obtain 0.81. 

[0018] The calculation is continued similarly until the end of the 
trellis is reached and all transition metrics have been found. 

[0019] In Figure 2b the search is expedited by using the Viterbi 
algorithm. According to the Viterbi algorithm, the path to be selected is 
decided on in every state 204, 206, 208, 210, 212, 214, 216, 218. The 
selection is made on the basis of the path metrics 220, 222. In path metric, the 
transition metrics of each path are summed at every state. According to the 
Viterbi algorithm, the path with the smaller path metric is selected from the two 



paths entering each decision state. This allows error probability to be 
minimized. The path selected in each decision state is called a survivor. 
Consequently, only one path per state is stored in the memory. The selected 
sequences are added to the previous sequences. Figure 2b shows the 
survivors only, the first one of which has a path metric that is the sum of the 
transition metrics, i.e. 0.04 + 0.16 + 0.16 = 0.36220, the path metric of the 
other one being 0.04 + 0.36 + 0.01 = 0.41222. 

[0020] Figure 2c illustrates the decision to be taken with regard to 
the symbol sequence that was sent. When the symbol sequences join at the 
end of the trellis diagram, final decisions with regard to the received symbols 
are taken. The path with the smallest path metric, in this case 0.37224, Is 
selected among the survivor paths, the symbol sequence assumed as 
transmitted thus being 0,1,0,0. It is to be noted that the complexity of the 
Viterbi algorithm grows exponentially as the impact length (memory length) 
increases and linearly In relation to the number of the states. 

[0021] There are also other methods for calculating the transition 
metrics than the squared Euclidean metric used in the above example, such 
as the Hamming metric, correlation metric and probability metric. In the 
Hamming metric, for example, the received signal is processed as symbol 
sequences, i.e. in a digital format. 

[0022] Figure 3 is a flow diagram illustrating the method steps for 
searching for a symbol sequence. The execution of the method starts at block 
300. In block 302 a channel impulse response is determined by measuring the 
power of the received signal at different delay values. The impulse response 
can also be estimated using prior art methods, which are not described in 
greater detail herein. The number of the impulse response values to be 
determined depends on the system, for example on the number of filter 
coefficients, and, from the point of view of applying the method, it can be freely 
selected. 

[0023] In block 304 the received signal is sampled using a prior art 
method to obtain observation values for the transition metric. 

[0024] Next, in block 306, one or more impulse response values are 
selected for the transition metric. By using several values, a more reliable 
result is obtained. The values selected for use among the impulse response 
values are either the highest values, which allows the received signal energy 
to be maximized, or the selection is made taking into account the reliability of 



the value as well, for example by selecting perhaps a weaker impulse 
response value, if it is a very reliable one, and leaving out a value which is 
high but unreliable. The selection can be made, as shown above, on the basis 
of a combined selection criterion or on the basis of value or reliability alone. 
The selection criterion suitable for each situation may be adopted. For 
example, reliability is emphasized, if prior information obtained from the 
system has shown it to provide the best result. 

[0025] In block 308 the comparison or reference signal used in the 
transition metric of the symbol sequence is determined by applying at least 
one impulse response value determined in block 302 and the symbol 
sequence assumed as transmitted. The reference signal takes for example the 
following form: 

K 

XK/WM«-^), Where (1) 

[0026] K is the length of the system memory; 

[0027] h(f(k)) is the value of the impulse response. According to the 
formula, the number of the impulse response values is determined on the 
basis of the length of the system memory and, from the point of view of 
executing the method, it may be freely selected; 

[0028] f(k) is a function of k. The expression illustrates that the 
calculation to determine the reference signal may include either all the impulse 
response values stored in the memory or only some of them. The calculation 
is preferably carried out using the impulse response value selected for the 
transition metric and later impulse response values, or some of them; 

[0029] x(n) is the symbol sequence assumed as transmitted, the 
number of the sequences being also determined, according to the formula, on 
the basis of the length of the system memory and, from the point of view of 
executing the method, the number may be freely selected. 

[0030] The symbol sequences assumed as transmitted are those 
transmitted by the transmitter. Their length (the number of bits per symbol) 
and the number of different symbol sequences depends on the system 
employed, particularly on the method of modulation, and, from the point of 
view of the improved search method, they may be freely selected. 
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[0031] In block 310 are determined differential tenns. They are 
determined as a squared Euclidean distance, for example, by using samples 
of received signals corresponding to the impulse response values selected in 
block 306 and reference signals. The differential term is calculated for 
example as follows: 

I ^ P 

Un) - Kf(k))x(n - k)\ , where (2) 



[0032] K is the length of the system memory; 

[0033] h(f(k)) is the value of the impulse response; 

[0034] f(k) is a function of k to describe that calculation of the 
reference signals needed for determining the differential terms may also be 
carried out using only some of all the determined impulse response values, 
particularly the impulse response value selected in block 306 and later impulse 
response values, or some of them; 

[0035] x(n) is the symbol sequence assumed as transmitted; 

[0036] r(n) is the sample obtained from the received signal. 

[0037] Differential terms are calculated for the signal samples taken 
from the received signal and corresponding to the selected impulse response 
values. 

[0038] In addition to the Euclidean metric shown in the example, 
other possible differential term metrics include for example the Hamming 
metric, correlation metric and probability metric. 

[0039] In block 312 is calculated the transition metric for the symbol 

sequence. 

[0040] According to the method, only some of all possible 
differential terms are selected to be used in the transition metric, for example 
the differential terms corresponding to the selected impulse response values 
calculated in block 310. This allows a transition metric conforming to the 
improved search method to be obtained. According to another embodiment, 
the transition metric is determined as in the prior art, differential terms 
corresponding to the selected impulse response values being then added to 
the transition metric, which also allows a transition metric according the 
improved search metric to be obtained. The maximum number of differential 
terms possible for the transition metric is determined by the length of the 
channel memory, i.e. the maximum number of impulse response values 



available. In the following, the selection of the transition metric terms will be 
described in greater detail with reference to the channel impulse response 
examples of Figures 4a-c. The examples are described only to facilitate the 
understanding of the invention, and they do not in any way restrict the 
application of the improved search method. The horizontal axis in Figures 4a-c 
represents time and the vertical axis amplitude or power. 

[0041] Figure 4a shows a channel impulse response in which the 
highest value is on the third impulse response tap. In this case three terms, for 
example, are selected for the transition metric, i.e. sample h(n) 400 
representing the time of observation and two previous samples h(n+1) 402 
and h(n+2) 404, samples h(n+3) 406 and h(n+4) 408 being left out, the 
transition metric according to the improved search method thus preferably 
taking the following form: 

\r{n)-Y,Kk)x{n-ki + 

Hn + l)-Y^Kk)xin + l-k)\ + (3) 

where |r(«)-^/2(A;)x(n- corresponds to a prior art solution, 
additional terms 

|r(K + 1) - Z Kk)x(n + 1 - and |r(« + 2) - g h(k)x(n + 2-k)^ 

being here referred to as additional transition metric terms. 

[0042] The example of formula 3 shows that in the additional 
transition metric terms of the improved search metric, the reference signal for 
the differential term may be determined using only some impulse response 
values. In that case, the selected impulse response value and later impulse 
response values, or some of them, are preferably taken into account. 

[0043] Figure 4b shows another channel example, the impulse 
response of which comprises two power taps h(n) 410 and h(n+1) 412. The 
prior art transition metric thus takes the following form: 
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\r{n) - h(0)x(n) - h(l)x(n - l)f 



(4) 



[0044] The transition metric according to the improved search 
method in turn takes for example the following form: 

5 \r(n) - h(l)x(n - l)f + \r(n + 1) - h(l)x(n)f (5) 

[0045] In the example of Figure 4c, the channel Impulse response 
comprises two high values: h(n+1) 416 and h(n+4) 422. In addition to these, 
h(n) 414 is included in the transition metric. Impulse response values 418, 420 
10 and 424 are left out of the metric. The prior art squared Euclidean transition 
metric thus takes the following form: 

Hn)-Y,Kk)x(n-k)\ (6) 

and the Hamming transition metric the form 



, where(7) 



[0046] Q[a] is variable a which is quantized to represent a 
predetermined number of symbols, 

[0047] dH(b, c) is the Hamming distance between numbers b and c. 
20 [0048] The squared Euclidean transition metric of the improved 

search method In turn takes for example the following form: 

I ^ r 

+ \r(n + 1) - h(l)x(n) - h(4)n(n - sf (8) 
+ \r(n + 4)-h{4)x(nf 

and the Hamming transition metric of the improved search method 
25 for example the form 



dH[Q[r(n)l h(k)x(n - k)^ 

+ dfj{Q[r(n + 1)], Q[h(l)x(n) + h(4)x(n - 3)]) (9) 
+ d^{Qlr(n + 4)],Q[h(4)x(n)]) 
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[0049] In other words, one embodiment of the improved search 
method provides a transition metric in which differential terms may be 
determined only for selected impulse response values and signal samples. In 
another embodiment, the transition metric is determined according to the prior 
5 art, differential terms, referred to as additional transition metric terms in this 
context, corresponding to the selected impulse response values being added 
to this transition metric. Moreover, the calculation of reference signals needed 
for determining the additional transition metric terms or other differential tenns 
according to the improved search method may be carried out using only some 
10 of all determined impulse response values, preferably the impulse response 
u value the sample signal corresponding to which is used for calculating the 

P differential term and later impulse response terms, or some of them. 

[0050] In block 314 is formed a survivor path by adding the symbol 
i-, sequence obtained on the basis of the transition metric to the survivor path 

- 15 formed so far. A survivor path is the path entering a decision state that 
provides the smallest path metric, i.e. the path in which the sum of the squared 
Euclidean distances or the sum of the Hamming distances, for example, is the 
smallest. 

f [0051] When the search for the symbol sequence is not yet 

?~ 20 complete, i.e. there are still states left In the trellis diagram, for example, the 
H transition metric determined as described above is added to the previously 

formed path metric, or, If the path metric is to be kept In line with the originally 
selected metric, such as the sum of the squared Euclidean distances or the 
sum of the Hamming distances, the transition metric according to the improved 
25 search metric is used only for selecting the survivors, and a transition metric 
calculated using a prior art method Is added to the path metric. Only the 
survivors are stored in the memory for the next decision state. 

[0052] The above described transition metrics determined using the 
improved search method and transition metrics determined using a prior art 
30 method can also be combined to determine the path metric. The path metric 
then comprises transition metrics some of which are determined according to 
the prior art and the other according to the improved method. For example, the 
path metric is first calculated according to the prior art and then according to 
the improved method. The path metric terms, or some of them, may also be 
35 weighted averages. 
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[0053] The execution of the method continues until the entire 
symbol sequence searched for is found. Then, if reception continues, the 
search for a new symbol sequence begins. 

[0054] Arrow 316 Illustrates the reproducibility of the method 
whenever a new impulse response is to be determined. Arrow 318 illustrates 
the reproducibility of the method for a following sample value taken from the 
received signal, without the impulse response being determined again. The 
method can be repeated also by sampling a signal and leaving the channel 
impulse response undetermined. The execution of the method ends in block 
320. It is to be noted that in the above formulas (1) - (9), the impulse response 
values are usually estimates, not exact values. 

[0055] The examples show that the transition metrics are usually 
more complex than the prior art metrics, but this is compensated for by the 
absence of the prefilter and by the greater probability of the found symbol 
sequence to be the correct one, i.e. improved performance. Figures 5a-b 
show, by way of example, results of simulations relating to the channel 
examples of Figures 4a-b. It is to be noted that the applied modulation method 
and algorithm as well as the number of bits used in the simulation also have 
an effect on the individual simulation results. The simulation results illustrate, 
however, general tendencies in the system behaviour. 

[0056] Figure 5a shows simulated bit error ratio curves based on 
the channel example of Figure 4a. Figure 5b shows simulated bit error ratio 
curves based on the channel example of Figure 4b. Bit error ratio Is the 
number of incorrect bits to all bits, bit error ratios illustrating the performance 
of the system. The vertical axis represents the bit error ratio and the horizontal 
axis the ratio of bit energy to the power density of noise, which illustrates the 
signal-to-noise ratio. Curves 500 and 504 are based on the prior art and 
curves 502 and 506 on the improved transition metric. Figures 5a-b show that 
there is a significant difference in the performances in favour of the improved 
transition metric, particularly when high signal-to-noise ratio values are 
concerned. It is to be noted that in the situation shown in Figure 4b in 
particular, where the value of the second impulse response is significantly 
higher than the value of the first impulse response, the Improved metric offers 
clearly better performance than the prior art metric. 

[0057] In the following, an example of a receiver structure will be 
described with reference to the block diagram of Figure 6 where the improved 
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search method is applied to channel equalization. The receiver may be located 
for example at a base station or in a subscriber terminal. The example of 
Figure 6 shows only the channel equalizer and associated parts of the 
transmitter. It is apparent to a person skilled in the art that the transmitter 
usually comprises also other parts than those shown in Figure 6. These parts 
are not shown here because they are not essential for describing the example. 
In addition, the transmitter parts vary according to the radio system standard 
applied. For example, systems based on spread spectrum technology 
comprise means for spreading the signal to be transmitted and means for 
despreading the signal to be received. 

[0058] The information sequence to be transmitted x(n) 600 is 
supplied to a transmitter 602 and further relayed to an antenna or antenna 
group 604 for transmission to the radio path. The transmitter is implemented 
using a prior art solution. The execution of the method does not restrict the 
method selected for Implementing the transmitter. The signal is then received 
by the receiver's antenna or antenna group 606, the received signal being then 
relayed to the receiver's radio frequency parts 608 where undesired 
frequencies are typically filtered from the received signal and the received 
signal is down-converted to an intermediate frequency or directly to baseband. 
The signal is sampled using sampling means 610 preferably at a symbol rate, 
a discrete analog signal r(n) 612 being thereby obtained which can be 
modeled for example as follows: 

K 

fi") = Y,Kk)x(n -k) + w(n) , where (1 0) 

k=0 

w(n) is the channel noise term. 

[0059] A channel estimator 616 is used according to a prior art 
method for determining the channel impulse response values, which are 
typically estimates, not exact values. These impulse response estimate values 
h(0),h(l)...,h(K) 618 are supplied to a detector 614 where signal samples r(n) 
612 are also supplied to. The detector 614 employs the above described 
improved search method to determine, in this case, a symbol sequence 
estimate x(n) 620 that contains the fewest errors by means of transition 
metrics and/or path metrics. 

[0060] The invention is preferably implemented by software, in 
which case the base station or subscriber terminal, for example, comprises a 
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microprocessor in which the software executing the functions of the described 
method is run. The invention can also be implemented for example by means 
of hardware solutions offering the required functionality, such as ASIC 
(Application Specific Integrated Circuit), or by means of discrete logic 
components. 

[0061] It is to be noted that the described improved search method 
for searching for a symbol sequence is not only applicable for use in the 
channel equalizer structure shown in this example, but in all operations 
employing trellis or tree search algorithms or suboptimal algorithms based on 
these. 

[0062] Although the invention is described above with reference to 
an example according to the accompanying drawings, It is apparent that the 
invention is not restricted to it, but may vary in many ways within the inventive 
idea disclosed In the claims. 



